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Abstract 

We study a generic Higgs boson and a top quark associated production via model-independent 
flavor-changing neutral-current (FCNC) couplings at the LHC, including complete QCD next-to- 
leading order (NLO) corrections to the production and decay of the top quark and the Higgs 
boson. We find that QCD NLO corrections can increase the total production cross sections by 
about 48.9% and 57.9% for the Htu and Htc coupling induced processes at the LHC, respectively. 
After kinematic cuts are imposed on the decay products of the top quark and the Higgs boson, the 
QCD NLO corrections are reduced to 11% for the Htu coupling induced process and almost vanish 
for the Htc coupling induced process. Moreover, QCD NLO corrections reduce the dependence of 
the total cross sections on the renormalization and factorization scales. We also discuss signals of 
the tH associated production with the decay mode t —> bl + fJr, H — > bb and ti production with the 
decay mode i — > Hq, t — > bl + ^Jr. Our results show that, in some parameter regions, the LHC may 
observe the above signals at the 5a level. Otherwise, the upper limits on the FCNC Htq couplings 
can be set. 
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I. INTRODUCTION 



Recently the ATLAS and CMS collaborations at the Large Hadron Collider (LHC) have 
discovered a new particle with a mass of about 125 GeV S| • In the near future, the most 
important task is to study the intrinsic properties of this new particle, such as the couplings 
and spin, which will determine whether it is the Standard Model (SM) Higgs boson, and 
lead to deeper understanding of electroweak (EW) symmetry breaking mechanism. 

It is attractive to investigate the anomalous couplings of a generic Higgs boson, such as 
the anomalous couplings with quarks via flavor-changing neutral-current (FCNC). In the 



SM, FCNC is absent at tree 



evel, and is suppressed at one-loop level by the Glashow- 



Iliopoulos-Maiani mechanism 3]. The anomalous couplings, if exist, are strong evidence 
of New Physics (NP). In Ref. 4], indirect constraints on FCNC couplings from low-energy 
experiments are studied and used to analyze the process of the Higgs boson decaying to light 
quarks or leptons. But the FCNC couplings between the Higgs boson and the top quark are 
not discussed there. 

The top quark mass is close to the EW symmetry breaking scale. Thus it is an appropriate 
probe for the EW symmetry breaking mechanism and NP. Any deviation from SM prediction 
for precise observables involving top quarks exhibits hints of NP. The production of a single 
top quark associated with a gluon jet or a vector boson via FCNC couplings has already 
been investigated at the leading order (LO) 5|-l8|] and at the next-to-leading order (NLO) [9- 
[3], respectively. In this paper, we will discuss the constraints on the FCNC Htq couplings 
from the signal of the Higgs boson and the top quark associated production with QCD NLO 
accuracy at the LHC. 

In some NP models, the FCNC couplings of the Higgs boson and the top quark can be 
generated at tree level, or enhanced to observable levels through radiative corrections jj- 



14j | . such as the two Higgs doublet models III 15j, |l6j, the minimal supersymmetric models 



(MSSM) [12H22J, the top co lor- assisted technicolor model [16], the exotic quarks models and 
the left-right symmetric models 23|, |24j. Since we do not know which type of NP will be 
responsible for the future deviation, it is better to study the FCNC processes with a model 
independent method. In general, the interactions between the Higgs boson, the top quark 
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and a light quark q (= u, c) can be expressed as j^] 

C = -£m E 9« q{$l + 9 a qt l 5 )tH + H.c., (1) 

q=u,c 

where g qt (q = u, c) defining the strength of the coupling is a real coefficient, while gL, gZ are 
complex numbers, normalized to \g v qt \ 2 + \g qt \ 2 = 1. The constraints on the above couplings 



have been set through indirect low-energy processes in Refs. [2514271] . It is interesting to study 
how to set the direct constraints on the above couplings from the signals of the top quark and 
the Higgs boson associated production and top pair production with top quark rare decay 
at the hadron colliders. These processes have been studied at the LO in Ref. However, 
the LO total cross sections at the hadron collider suffer from large uncertainties due to the 
arbitrary choices of the renormalization and factorization scales. Besides, at the NLO level 
the additional radiation makes fe-jets, which are the products of the Higgs boson and the top 
quark, softer and the mass distribution of the reconstructed particles broader, which will 
affect events selection when kinematic cuts are imposed. Thus, it is necessary to perform 
complete QCD NLO calculations of these processes at the LHC, including production and 
decay. 

The arrangement of this paper is as follows. In Sec. [TT1 we present the LO results for the 
Higgs boson and the top quark associated production induced by FCNC Htq couplings. In 
Sec. IHIl we describe the detailed calculations of the NLO results, including the virtual and 
real corrections. Then in Sec. IIV} we investigate numerical results, in which we discuss the 
scale uncertainties and give some important kinematic distributions. In Sec|V] we discuss 
the signals of tH associated production with the decay mode t — y bl + v e and H —y bb, and tt 
production with rare decay mode t —y Hq —y bbq. Then we analysis the discovery potential 
with QCD NLO accuracy at the LHC with v^S* = 14 TeV. Section |VT] is a brief conclusion. 

II. LEADING ORDER RESULTS 

At the hadron colliders, there is only one subprocess that contributes to the tH associated 
production at the LO via FCNC Htq couplings: 

gq ^ tH, (2) 

where q is either u or c quark. The Feynman diagrams are shown in Fig. [TJ 
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FIG. 1: The LO Feynman diagrams for tH associated production via FCNC Htq couplings. 

After summing (averaging) over the spins and colors of the fmal-(initial-)state particles, 
the explicit expression of the squared amplitude at the LO is 

2 2 

Wn\ g (s,t) = ™ a ' 9 « (m t 6 - {2ml + 2* + t)m? + (2m% + (s + tf)m\ - 

3sin^s (t — mf) 

2tm% + 2t(s + t)m 2 H - t(s + t) 2 ) , (3) 

where m t and uih are the top quark mass and the Higgs boson mass, respectively. The 
Mandelstam variables s, t and u are defined as 



s = (pi + p 2 ) 2 , t = (pi - P3) 2 , « = (Pi - P4) 2 - (4) 

The LO total cross section at hadron colliders is given by convoluting the partonic cross 
section with the parton distribution functions (PDFs) Gj/p in the proton, 

o B = J dx 1 dx 2 [G g / Pl {x u /j, f )Gq/p 2 (x 2 , /if) + (xi <-> z 2 )] (5) 

where fif is the factorization scale, and = (l/2s) / lA^^p^rfPS 1 ^ 2 ^ is Born level partonic 
cross section. 



III. THE NEXT-TO-LEADING ORDER CALCULATIONS 

In this section, we present QCD NLO corrections of tH associated production using 
dimensional regularization scheme with naive 75 prescription in n = 4 — 2e dimensions 
to regularize the ultraviolet (UV) and infrared (IR) divergences. The NLO corrections 
contain the virtual gluons effects and the real radiation of a gluon or a massless quark. The 
corresponding Feynman diagrams are shown in Fig. [2] and Fig. [31 respectively. We use two 
cutoff phase space slicing method 



in the real corrections to separate the IR divergences. 
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FIG. 2: One- loop virtual Feynman diagrams for the tiif associated production via FCNC Htq 
couplings. 

A. Virtual corrections 



The virtual corrections come from the interference of the one-loop amplitude with the 
Born amplitude: 



a v = y s J d p S (2) 2Re(M v ■ M B *). 



(6) 



We introduce counterterms to absorb UV divergences. For the external fields, we fix all the 
renormalization constants using the on-shell renormalization scheme: 



GO 



SZ. 



8Z® 



5m t 
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m t 
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CUV e IR 



(7) 



where C e = T(l + e) [(47r/i^)/r77f] , /i r is the renormalization scale and rif = 5. For the coun- 
terterm of FCNC couplings SZ gqt , we use the modified minimal subtraction (MS) scheme: 



C f a s 



1 



9qt " 4tt 2 \e uv 
and the running of the FCNC coupling is given by 



9qti.Hr) = gqtM 



4//30 



a s (/^o)7 



(8) 



(9) 



Here {3 = 11 — |ny is the one- loop coefficients of the QCD /3-function. 

After adding counterterms, the renormalized amplitude Ai v is UV finite, but still contains 
IR divergences, which are given by 

n , = s^4f¥T^+^«', do) 

where 



2vrr(l -2e) V s 7 Ve?R e/H 



^2 - 3, 



mi — t 1 , mi — u 4 , s 43 



A\ = 3 In ^5 In ^5 In —= . (11) 

mi 3 mi 3 mi 6 



B. Real corrections 



The real corrections contain the radiations of an additional gluon, and massless 
(anti) quark. The relevant Feynman diagrams are shown in Fig. [3j The partonic cross 




FIG. 3: Feynman diagrams for the real corrections to the tH associated production via FCNC Htq 
couplings. 
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section can be written as 



— [ dPS^\M R \ 2 . (12) 



We use two cutoff phase space slicing method [28], which introduces two small cutoffs 
5 S and 5 C to divide the three-body phase space into three regions. First, the phase space is 
separated into two regions according to whether or not the energy of the additional gluon 
satisfies the soft criterion E$ < 5 s y/s/2 in the partonic center-of-mass frame (CMF). And 
the partonic cross section can be divided as 

a R = a H + a s , (13) 

where <r H and a s are the contributions from the hard and the soft regions, respectively. 
Furthermore, the collinear cutoff 5 C is applied to separate the hard region into two regions 
according to whether the collinear condition — 5 c s < t i5 < is satisfied or not, where 
ti5 — (j>i ~ P5) 2 with i = 1,2. The corresponding cross section is splited into 

aH = ^HC + ^HC_ (14) 

where the contributions from hard-collinear regions <r HC contain the collinear divergences, 
and the hard-non-collinear part a is free of IR singularities and can be calculated numer- 
ically. 

1. Real gluon emission 

In the limit that the energy of the emitted gluon becomes small, i.e., < 5 sA /i/2, the 



amplitude squared \M.(qg — > tH + g)\ 2 can be factorized into the Born amplitude squared 
and the eikonal factor $ C ik: 

\M(qg ^ tH + g)\ 2 ^% (47ra s/ ^)pW^$ cik , (15) 

where the eikonal factor can be expressed as 

Ca s 1 m? — u 

$eik " 



2 (pi ■ Ps) (Pa ■ Ps) 2C A (pa ■ p 5 ) (p 3 • p 5 ) 
<° A ml ' t -C F f m \ 2 , (16) 



2 (P2-P5)(P3-P5) {.PZ-Ps) 2 ' 
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with Ca — 3, Cp = |. The three-body phase space in the soft region can be factorized into 



dPS {3) {qg ^tH + g)^% dPS (2) {qg -> 



where dS is the integration over the phase space of the soft gluon, given by 



dS 



\3-2e 



dE 5 El 2e dQ 2 -2e- 



2(2vr) Jo 

Hence, the parton level cross section in the soft region can be expressed as 



a b = (4vr« s /if )& B j ^ cik dS. 
After integration over the soft phase space, Eq. (Tl9|) becomes 



with 



a s = d B 



A 2 - 3 , 



a s T(l — e) f Att/i: 
27rr(l -2e) 



4 + ^ + ^ 



-J.R 



(17) 



(18) 



(19) 



(20) 



4? 



-2A* In 5 S + - In 



r/?, 



K 



3 In 



mf -t 4 



+ - In— ^ + -, 



mr 



A* = -2A% In 2 5 S - 2A* In 5 S + 4r In ^4 + - -S , 
o 2 1 s 3/3 1-/32 6 4 



(21) 



The B T are defined as 



B+ = In 2 



1-/3 



■In' 



1 + /3 



-2Li 2 



l±/3cos# 2" I 
±(3(cos9t 1)' 



/3 



+ 2Li 2 



T/3(cosfl± 1) 



(22) 



1 ± /3 cos 

where /3 = v/l — 4m 2 s/(m 2 — m 2 ^ + s) 2 and cos # = (t — u)/ \J (m 2 — + s) 2 — Am 2 s. 
In the hard-collinear region, collinear singularities arise when the emitted hard gluon 



is CO 
rem 



linear to the incoming massless partons. As the conclusion of the factorization theo- 



29 



301 ] . the amplitude squared \Ai(qg — » tH + g)\ 2 can be factorized into the product 



of the Born amplitude squared and the Altarelli-Parisi splitting function; that is 

coll 



\M(qg^tH + g) 



(4ira s iJ,; £ )\M 



t i;\2 j "2-Pgg(^; 6 ) _j_ 2P gg (^, e) 



(23) 



Zt\5 Zt<25 

where z denotes the fraction of the momentum of the incoming parton carried by q(g). The 
unregulated Altarelli-Parisi splitting functions are written explicitly as 28] 

■l + z 2 



C F 
2C A 



1-z 

z 

— z 



il-z)). 



+ z(l-z, 



(24) 



Then we factorize the three-body phase space in the collinear limit — 5 c s < t i5 < as 

(Any 



dPS^\qg tH- 



coll 



dPS {2 \qg^tH- s' = zs) 



-dzdU b [-(l-z)U b }-\ (25) 



16vr 2 r(l - e) 

Thus, after convoluting with the PDFs, the three-body cross section in the hard- collinear 



region can be written as 



28] 



a 



HC 



dx\dx 2 (X 



47T/1, 

2vrr(l -2e) V~ 



2\ e ' 



-) 5 c e [Pqq(z,e)G q / p (x 1 /z)G g/p (x 2 ) 



+P gg (z,e)Gg/ p (x 2 /z)G q / p (xi) + (x 1 ^ x 2 )] 
where G q ( g y p (x) is the bare PDF. 



dz ( 1 — z 



z \ z 



(26) 



2. Massless (anti)quark emission 

In addition to the real gluon emission, an additional massless q(q) in the final state should 
be taken into consideration at 0(a s ) of the perturbative expansion. Since the contributions 



from real massless q(q) emission contain initia 
the two cutoff phase space slicing method 



-state collinear singularities, we need to use 
to isolate these collinear divergences. The 



cross section for the process with an additional massless q(q) emission, including the non- 
collinear part and collinear part, can be expressed as 

a s r(l-e) /47r/i 2 ^ ' 

o yqa —f in f qyq) )^ q / p yx 1 )^ a / p yx 2 ) t» w 

(a=q,q,q') 



a 



add 



/ dxidx 2 ^2 \o c (qa -> tH + q{q))G q / p {x x )G a / p [x 2 ) + & 



1\ dz (\ — z 

--J 5 c e P ga (z,e)G q/p (x 1 )G a/p (x 2 /z) — ( 



dx x dx 2 \ d- c {gg ->■ tH + q)G g/p (x 1 )G g / p (x 2 ) + <r^ 



_27rr(l - 2e) 



a, rn 



_27rr(l - 2e) V s 



2\ e 



where 



l\ dz (\- z" 
— 1 5 C e P qg {z,e)G g / p {x x / z)G g/p {x 2 ) — ( ) (.<-, h- ,r 2 ; 



P 99 (z, e) = P qg (z) = - [z 2 + (1 - ^) 2 ] - z(l - z)e, 



(27) 



Pgq( z ) — Cf 



1+ 1-z) 



Z€ 



(28) 



9 



The a c is the non-collinear cross sections for the processes of the qq(q, q'), gg and q'q' initial 
states: 

\M(qa^tH + a)\ 2 + \M(gg—^tH + q)\ 2 + 

(ct=q,q,q') 

\M(q'q' —>•*# + g)| 2 }dPS ( g, (29) 

(3) 

in which dPS > -J is the three-body phase space in the non-collinear region. 




3. Mass factorization 

There are still collinear divergences in the partonic cross sections after adding the renor- 
malized virtual corrections and the real corrections. The remaining divergences can be 
factorized into a redefinition of the PDFs. In the MS convention the scale-dependent PDF 
G a / P (x, jif) can be written as j3] 



G a / p (x,Hf) = G a/p (x) + 



P 



a s T(l - e) / Airfi 2 , 
27rr(l - 2ej I 



f 1 dz 

J x Z 

The Altarelli-Parisi splitting function is defined by 



(30) 



Pap(y, e) = P a p(y) + tKpiy)- 



(31) 



The resulting 0(a s ) expression for the initial-state collinear contribution can be written in 
the following form: 



a 



coll 



dx\dx 2 a gg 



a s T(l-e) / 47T//, 2 N ei 
27rr(l - 2e) V^T 



G q / P (xi, ii f )G g / p (x 2 , fif) + G q/p (xi, /j lf )G g / p (x 2 , fif) + 
A{ c (a — >■ ag) 



E 



+ A s c (a -> ag) 



a=q,g 

(xi 4+ x 2 ] 



Gq/ p (Xi, fJ J f)Gg/p(x 2 , fif) + 



(32) 
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where 



AT(q^qg) = C F (2\n6 s + ^] 



A{ c {g^gg) = 2C A \n8 s + 



UC A -2n f 
6 ; 



and 



A S C = Af In | ± ] , (33) 



v-^ f 1 ' 5 ^ dy fx \ ~ 
G a/p (x,n f ) = 2^ —Gp/p{-,Hf)P at 3{y), (34) 

g j x y \y / 



with 



Papiv) = Pap{y)\n ( *c— 4 ) - P '^y)- (35) 

Finally, we combine all the results above to give the NLO total cross section for the 
pp — > tH process: 

a NLO = J d Xl dx 2 | [G q/p (x lt n f )Gg /p (x 2l Hf) + x 1 x 2 ] (a B + a v + a s + a HC )} + a cM 
+ ^ / dxxdx 2 [G a / p (x 1 ,fj,f)G/3/p(x 2 ,iJ,f) + (xi <->> x 2 )] a c (a(5 -)> tH + X), (36) 

where (a, (3) stand for the qq(q, q') , gg and q'q' initial states. Note that there contain no 
singularities any more, since A 2 + A 2 = and A\ + A{ + Af^g — )■ gg) + ylf c (^ — >■ gg) = 0. 

IV. PRODUCTION CROSS SECTION 

In this section, we give the numerical results for the total and differential cross sections 
for the Higgs boson and the top quark associated production via the FCNC Htq couplings. 

A. Experiment Constraints 

Before proceeding, we discuss the choice of the FCNC Htq couplings, which is constrained 
by low-energy data on flavor-mixing process. For example, in the precision measurement of 
the magnetic dipole moments of the proton and the neutron, the contribution of g u t vertex 



should be less than the experimental uncertainty 

11 



25 



26(. The result reveals that Im{gt^) is 



more strongly suppressed than Re(g v a1 ). Therefore the FCNC Htq coupling can be described 
by only one real parameter, i.e., the strength of the coupling g qt , which is constrained as 

=g ut < 54vr v — — , (37) 



2y/2 J x t x p g(x t ) 



where 



_ 3 + x 2 (x 2 -4) + 21og(x 2 ) 

with x a = m a /i7iH- 

In D°-D° mixing, the g u t and g c t couplings can contribute to the mass difference AMu 



through loop effects. Experiment results impose limits on g ut and g ct as 



25 



26|: 



L73 x 10-2 

\9ut9ct\ < -=====, (39) 
Vf( x ) - 2 9{x) 



where 



2(1 — xr 



= n-^s ^ 1 ~ x ) + ( 1 + x ) lo S^ (40) 



with x = m 2 H /mf. 



couplings 


upper Limits 


Experiments 


9ut 


0.363 ~ 0.393 


magnetic dipole moments [25] 


9ut9ct 


0.0194 ~ 0.0272 


D°-D° mixing [25] 


9ct 


0.270 ~ 0.319 


Z -> cc [27] 



TABLE I: The 95% C.L. upper limits on the FCNC Htq couplings obtained from the low-energy 
experiments, with Higgs boson mass in the range from 115 GeV to 170 GeV. 

The EW precision observables Tz, R c , Rb, Ri, A c and A C FB also impose constraints on the 
couplings g c t through the radiative corrections to the effective Zee vertex j^]. In Tabled 
we list the 95% C.L. upper limits on the FCNC Htq couplings obtained from the low-energy 
experiments. 
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B. Cross sections at the LHC 



Now we discuss the numerical results of the Higgs boson and the top quark associated 
production at the LHC. Unless specified otherwise, we choose g ut = 0.2 and g ct = 0.2, which 
are allowed by the low-energy experiments. We have checked that the imaginary part of 
these couplings do not contribute to the final results, so Im(g^ t ) is neglected in numerical 
calculations. Other SM input parameters are: 

m t = 173.1 GeV, m H = 125 GeV, m w = 80.398 GeV, m b (m b ) = 4.2 GeV, 

a = 1/127.921, sin 2 9 W = 0.2312, a s (m z ) = 0.118. (41) 

The CTEQ6L (CTEQ6M) PDF sets and the corresponding running QCD coupling constant 
a s are used in the LO (NLO) calculations. The factorization and renormalization scales are 
set as fMf = \i T = [Aq, and fiQ = m t + mu- Moreover, as to the Yukawa couplings of the 
bottom quark, we take the running mass m b (Q) evaluated by the NLO formula [3l| 

m b (Q) = U 6 (Q,m t )U 5 (m t ,m b )m b (m b ), (42) 

The evolution factor Uf is given by 



U f (Q,.Qr- ' asiQ ' 



with 



^ CXsiQl) ~ gg(g2) j(n } ) 
47T 



(43) 



, v 12 , x 8982 - 504n f + 40n 2 f 

d (n f ) = j{n f ) = / / / 44) 

33 -2n/' 3(33 -2n/) 2 v ; 



In Fig. HI we show the dependence of the NLO cross sections on the cutoffs 8 S and S c . 
In fact, the soft, collinear and the hard-non-collinear parts individually strongly depend on 
the cutoffs. But the total cross section is independent on cutoffs after all pieces are added 
together. From Fig. HJ we can see that the change of a NLO is very slow for 5 S in the range 
from 10~ 6 to 10~ 2 , which indicates that it is reasonable to use the two cutoff phase space 
slicing method. 

In Fig. [51 we give the scale dependences of the LO and NLO total cross sections. Explicitly, 
we consider three cases: (1) factorization scale dependence (/x r = /x and /i/ = //); (2) 
renormalization scale dependence (/!/ = fi and /i r — fi); (3) total scale dependences (/i/ = 

13 



O -5 
-10 
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2-body 




• • ■ ■ 3-body 
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FIG. 4: Dependence of the NLO total cross sections at the LHC on the cutoff scale 5 S with 
<5c = <5 s /50. The label 2-body represents the LO cross section, the one-loop virtual corrections, the 
soft and hard-collinear limits of the cross sections of three-body final states, while the label 3-body 
denotes the cross sections of hard-non-collinear part. 




FIG. 5: Scale dependences of the cross sections for the gu initial state subprocess at the LHC. 

\x r = fi). From Fig. |5l we find that the NLO corrections significantly reduce the scale 
dependences for all three cases, which makes the theoretical predictions more reliable. 
Figure E] presents the dependence of the total cross sections on m#. It can be seen that 
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FIG. 6: The LO and NLO total cross sections and K factors as functions of ran- The solid lines 
and the dotted lines represent the LO and NLO cross sections, respectively. 

the cross sections decrease by about 16% as m# increases from 115 GeV to 135 GeV. In 
Fig. [6J the K factors, defined as <j NLO ja LO , are also shown. We can see that the K factors 
for ug tH, ug — > iH and c(c)g — > tH processes are 1.49, 1.54 and 1.58, respectively, at 
the LHC for m# = 125 GeV, and they are not sensitive to the Higgs boson mass. 




Pr,t(GeV) p TH(GeV) 

FIG. 7: The transverse momentum distributions of the top quark and the Higgs boson at the LHC. 
The solid line and the dotted line represent the LO and the NLO results, respectively. 

Figure [7] shows the differential cross sections as a function of the transverse momentum 
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of the top quark and the Higgs boson. We find that they are very similar and the peak 
positions are around 80 GeV. In Fig. |H1 we present the distributions of the invariant mass of 
the top quark and Higgs boson, and the peaks are around 360 GeV. From these figures, we 
can see that the NLO corrections significantly increase the LO results, but do not change 
the distribution shapes. 




FIG. 8: Distributions of the invariant mass of the top quark and Higgs boson. The solid line and 
the dotted line represent the LO and the NLO results respectively. 

V. SIGNAL AND DISCOVERY POTENTIALITY 

In this section, we investigate the signal and corresponding backgrounds in detail and 
present the discovery potential of the signal of the tH associated production at the LHC. 

A. NLO prediction on FCNC tH associated production and decay 

We have discussed the QCD NLO corrections to tH associated production in the last 
section. In order to provide a complete QCD NLO prediction on the signal, we need to 
include the QCD NLO corrections to the decay of the top quark and the Higgs boson. In 
this work, we concentrate on the top quark semileptonic decay and the Higgs boson decaying 
to bb, as shown in Fig. |HJ 

The complete NLO cross section for tH associated production and decay can be written 
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as 



„™ {pp _ t h „ ll+b) +Hhm = K + a , ai) x (%^f) (f^ff )«) 

where <7n is the LO contribution to the tH associated production rate, Tq,Tq are the LO 
total top quark and Higgs boson decay width, and 5Tq, 5Tq are the decay width of the top 
quark decaying into vil + b and the Higgs boson decaying into bb. a s cri, (x s T\ and a s ST\, with 
i = t,H, are the corresponding NLO corrections. We choose Tq = 3.28 x 10~ 3 GeV, ouTf = 



4.07 x 10~ 3 GeV. And we ca: 
adopt NLO results in Ref. 



culate width of the Higgs boson by Bridge at the LO 32], and 



33] . Here we use the modified narrow width 
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approximation 



35|. 



(MNW) incorporating the finite width effects as the treatment in Refs. 
We expand Eq. (f45l) to order a s , 

NLO 6TI 6T» SrlST* a s 6T[ 6T% 

a = <Tn X —7-— -77- + Ot s a\ X — — + <Tn X — — : —77 — 

1 1 i o i o i o i o 

a o>< rt rt rH +^oX -a x +0(a s ). (46) 

i i i 1 1 i o i o i o 

Now we can separate QCD NLO corrections into three classes, i.e., the tH associated pro- 
duction at the NLO with subsequent decay at the LO, production at the LO with subsequent 
decay at the NLO, and production and decay at the LO but having NLO corrections from 
MNW. We note that QCD NLO corrections to the top quark decay part will contribute 



little since the branching ratio of the top quark decaying into W boson is always 100% 36]. 
As a consequence, the third term and the fourth term of Eq. (j46|) almost cancel each other. 
Since we only consider one decay mode of Higgs bosons, the sum of the fifth term and the 
sixth term will give a negative contribution. 

There is another process, which is at the same order as the tH associated production at 
the NLO (Fig. (Right)), i.e., ti production with the top quark semilepton decay and the 
antitop decaying into Hq via FCNC vertex. It has the same signal if the light quark from 
the top quark is missed by the detector. This additional contribution is very significant for 
detecting the g ct couplings, because the eg — > tH process is suppressed by c quark PDF. 
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FIG. 9: Representative Feynman diagrams for tH production and tt — > tHq production via FCNC 
Htq couplings. 

B. Collider simulation 

To account for the resolution of the detectors, we apply energy and momentum smearing 
effects to the final states 

AEi/Ei = 0.05/WGeV© 0.0055, 

AE b(j) /E bU) = 1/y^/GeV © 0.05, (47) 

where Ei tb j are the energy of the lepton, 6-jet and the other jets, respectively. 

We use the anti-fct jet algorithm [38] with the jet radius R = 0.4 and require the final-state 
particle to satisfy the following basic kinematic cuts 

p Tl > 25 GeV, Et > 25 GeV, p Tb> . > 25 GeV, 

\rji\ < 2.5, \r] bJ \ < 2.5, AR b i Jlybj > 0.4, (48) 

Here pr is the missing transverse energy. PT bjl and r\ b ^^ are the transverse momentum 
and pseudorapidity of the 6-jet, other quark jets and leptons, respectively. And AR = 
a/ (Ar/) 2 + (A0) 2 stands for the angular distance. Moreover, we choose a 6-tagging efficiency 
of 0.6 for 6-jets and mistagging rates of 1% for other quarks. 



C. Events selection 



The main background arises from the tt production with one top quark leptonic decay 
and the other top quark hadronic decay. Other backgrounds include Wbbj, WZj and 
Wjjj production processes. These backgrounds are calculated at the LO by using the 



MADGRAPH4 1391 and ALPGEN 



40[ programme. 
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For the signal, we require three tagged 6-jets 6 1 ' 2,3 , a lepton / + and the missing energy 
in the final states. The momentum of neutrino can be obtained by solving the on-shell 
mass-energy equation of the W boson 

(Pi + Pu,t + Pu,l) 2 = mw r , (49) 

where p\ is the momentum of the lepton, and mw,r is the reconstructed W boson mass. 
We denote the longitudinal and transverse momentum of the neutrino as p Uy L and p v ,T, 
respectively. Since we generate intermediated particles with the MNW method, the masses 
of the intermediated particles change with Breit-Weinger-Distribution (BWD) in a region 
of twenty times of their widthes around the central value set in Eq. (l4"Tj) . At the same time, 
smearing effects on the final state particles also affect the reconstructed W mass. As a result, 
if we choose a low mass of W boson, there may be no solution for p v ^ in Eq. ( 149]) . So we 
must estimate a W boson mass, which is large enough to provide the solution of mass-energy 
equation and small enough to reconstruct the proper top quark mass. Since there are three 
6-jets in the final states, it is necessary to determine the proper combination of the 6-jets to 
reconstruct the top quark mass m t r and the Higgs boson mass mn, r - In practice, we adopt 
the following steps: 

(1) We choose mw,r randomly with BWD when solving Eq. fj4*9]) to get the neutrino 
longitudinal momentum. For such m\y,r, it is required to provide real solutions of the 
equation. If not, discard this value of m^j. and redo this step until we obtain real solutions. 

(2) In order to improve the W boson reconstruction efficiency and save calculation time, 
we repeat step 1 for ten times and denote the solutions as p^ J L , with i — 1, 2, j — 1, • • *, 10. 
The superscript i represents the number of the solutions in Eq. fj49"]) . 

(3) Choose one momentum of the 6-jets p\, k = 1, 2, 3 and one of p l f L to reconstruct the 
top quark mass rn t f k = yj (pi) 2 + (p^ L ) 2 + (Pu,t) 2 + (pt) 2 - 

(4) For all combinations of (i, j, k), we choose the best one to minimize \m l ^ k — m t \. 

(5) Use the remnant 6-jets to reconstruct Higgs boson mass m k Hr . 

In order to choose appropriate kinematic cuts, we show some important kinematic distri- 
butions for the signal and the backgrounds. In Fig. [TDl we present dependence of differential 
cross sections of the signal and backgrounds on Ht, defined as the scalar sum of lepton and 
jet transverse momenta. From the figure, we can see that the distributions of Wjjj, WZj 
and Wbbj backgrounds have peaks below 200 GeV, while the peak positions of the signals 
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FIG. 10: Dependence of differential cross sections on Ht- The label tH represents the tH associated 
production, while the label tHq stands for the process of tt production with rare decay mode 
it — > tHq. The other labels denote the backgrounds. 

are about 240 GeV. Therefore we choose the Ht cut 



H T > 200 GeV. 



(50) 
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FIG. 11: The reconstructed top quark and Higgs boson mass. The labels here are the same as 
those in Fig [TOj 

Figure [TTJ illustrates the distribution of the reconstructed Higgs boson mass of the signal 
and backgrounds. We can see that the signals have peaks around 125 GeV, while the 
distributions of backgrounds are continuous or have peaks at other places. In order to 
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suppress Wbbj, WZj and Wjjj backgrounds, we require the mass of the Higgs boson to 
satisfy 

Am H , r < 20GeV, (51) 

where Am# r is defined as \m,H,r ~ Tnjj\. The reason will be explained in more detail in the 
appendix. We also show the distribution of the reconstructed top quark mass in Fig. [TT1 
where the signal and the backgrounds have similar distributions. As a result, we choose the 
cut 

Am t<r < 20GeV (52) 
to keep more signal events, where Am^ is defined as \m tir —mt\. 




FIG. 12: Dependence of differential cross sections on the rapidity of the Higgs boson and the top 
quark. The labels u(c)g represent the u(c)g — > tH associated productions, while the label tHq 
stands for the process of ti production with rare decay mode ti — > tHq. The other labels denote 
the backgrounds. 

To determine the rapidity cut, we present the normalized spectrum of the rapidity of 
the reconstructed resonances for the signal and backgrounds in Fig. [T2J It can be seen the 
Higgs boson from the ug — > tH associated production concentrates in the forwards and 
backwards regions. This is due to the fact that the momentum of initial u quark is generally 
larger than that of gluon, so the partonic CMF is highly boosted along the direction of the 
u quark. On the contrary, the main contribution of top pair production comes from gluon 
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initial-states, which are symmetric and have small boost effect. So we impose rapidity cut 
on reconstructed Higgs boson for the signal of ug — > tH process as 

\VH,r\ > 1-0. (53) 

However, since c quark is the sea-quark, the momentum of initial c quark is much smaller 
than that of the initial u quark. As a result, the Higgs boson from eg initial states is 
not boosted as from ug initial states. In addition, the cross section of ti — > tHc decay is 
comparable to that of eg — > tH process. Therefore when discussing the Htc couplings, we 
do not apply the cut in Eq. f )53|) . 

The complete set of kinematical cuts is listed in Table [TT1 



basic cut 


p Tj > 25 GeV, p Tl > 25 GeV, fir > 25 GeV, 




\r]ij\ < 2.5, AR b i,ji,bj > 0.4 


Hx 


H T > 200 GeV 


m t , r 


Am t < 20 GeV 


m U .r 


Am H < 20 GeV 


VH,r 


\VH,r\ > 1-0 



TABLE II: Kinematic cuts in the event selection. 



D. Simulation results 

In this subsection, we discuss the numerical results after imposing kinematic cuts. We 
need to include the QCD NLO corrections to the decay as well. As a result, we find that 
these corrections reduce the cross sections by about 50% for the g ut coupling induced process 
and by about 100% for the g ct coupling induced process, respectively. The corresponding 
results are listed in Table IIHI K pro only includes the NLO corrections to the tH associated 
production, while K to t also contains the NLO corrections to decay. The complete QCD NLO 
corrections are 11% for ug — > tH and almost vanish for eg — > tH. 

We list the results after imposing various kinematic cuts in Table IIVI For the ug — > tH 
process, the clear signal with the coupling g ut = 0.2 can be observed at the 5a C.L. when the 
integrated luminosity is 100 ftT 1 at the LHC Here we define the discovery significance as 
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olo [fb] 




Ktot 


tug 


6.64 


1.22 


1.11 


teg 


0.428 


1.40 


1.00 



TABLE III: The LO cross sections and K factors of the tH associated production at the LHC 
{dqt = 0.2) with the kinematic cuts in TabldlTl applied. We define K pro and Ktot to be the K factor 
of the process of tH associated production and the processes including production and decay, 
respectively. We apply all cuts for the g u t coupling induced process. But for the g c t coupling 
induced process, we do not apply the rapidity cut on the reconstructed Higgs boson. 







basic cut 


Ht 


m t>r 


rriH,r 


VH,r 


^cut 


ug 


-> iiT(NLO) 


3.54 


3.26 


2.86 


2.22 


1.59 


44.9% 


eg 


-> tfT(NLO) 


0.40 


0.354 


0.322 


0.240 


0.09 


22.5% 


tt 


-> tHq(LO) 


0.993 


0.956 


0.849 


0.487 


0.193 


19.4% 




tt 


21.0 


19.9 


17.3 


9.55 


3.89 


18.5% 




W + bbj 


3.30 


2.32 


1.38 


0.336 


0.146 


4.4% 




W + Zj 


0.215 


0.160 


0.099 


0.023 


0.010 


4.7% 




W + jjj 


0.085 


0.064 


0.038 


0.009 


0.004 


4.7% 



TABLE IV: Cross sections (in fb) after imposing cuts for NLO tH, tH(q) signal, and their back- 
grounds ti, Wbbj, Wjjj and WZj. The cut acceptance e cu t is also listed. The 6-tagging efficiency 
has been taken into account in the basic cut. 

S/y/B = 5 and exclusion limits as S/\fS + B = 3, where S and B are the expected events 
numbers of the signal and the backgrounds. However, for the ug — > tH process, the cross 
section of the process tt — > tHc is about 2 times larger than that of the process eg — > tH 
after cuts. As stated before, we choose data from the fifth column of Table HVl As a result, 
the 5cr C.L. discovery sensitivity of g c t is 0.294 when the integrated luminosity is 100 fb -1 
and rriH = 125 GeV. 

We show the 5<r discovery sensitivities to FCNC couplings with several Higgs boson mass 
for different luminosities in Fig. [T3J For a lighter Higgs boson, the cross sections become 
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FIG. 13: The 5a C.L. discovery sensitivities to the FCNC Htq couplings. The lines from bottom 
to top correspond to the ran from 115 GeV to 130 GeV. 

larger, but the branching ratio rates of Br(H — > bb) get lower. When m# = 115 GeV and 
integrated luminosity is 100 fb -1 , the limit on the g ut coupling is 15% smaller than that for 
mil = 125 GeV. In contrast, when the Higgs boson mass increases to ran = 130 GeV, the 
limit is increased by 12.3%. The g c t coupling has the similar behavior. 
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FIG. 14: The 3a C.L. exclusion limits to the Htq couplings. The lines from bottom to top 
correspond to the ran from 115 GeV to 130 GeV. 



If no signal is observed, it means that the FCNC Htq couplings can not be too large. 
In Fig. H3J we show the 3cr exclusion limits of couplings with several Higgs boson masses 
for different luminosities. The upper limits on the size of FCNC couplings are given as 
Qut < 0.121 and g ct < 0.233 with mu = 125 GeV. These limits can be converted to the 3cr 
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C.L. upper limits on the branching ratios of top quark rare decays 




as follows: 



Br(t -»■ Hu) < 4.1 x 10~ 4 , Br(t -»• He) < 1.5 x 10~ 3 . (54) 

VI. CONCLUSION 

In conclusion, we have investigated the signal of the tH associated production via the 
FCNC Htq couplings at the LHC with y/S = 14 TeV, including complete QCD NLO cor- 
rections to the production and decay of top quark and Higgs boson. Our results show that 
the NLO corrections reduce the scale dependences of the total cross sections, and increase 
the production cross sections by 48.9% and 57.9% for the Htu and Htc couplings induced 
processes, respectively. After kinematic cuts are imposed on the decay products of the top 
quark and the Higgs boson, the NLO corrections are reduced to 11% for the Htu coupling 
induced process and almost vanish for the Htc coupling induced process. 

We also discuss the Monte Carlo simulation results for the signal and corresponding 
backgrounds. For the signal, we include the process of top quark pair production with one 
of the top quarks decaying to Hq as well. We show that the NP signals may be observed 
at the 5a level in some parameter regions. Otherwise, the 3a upper limits on the FCNC 
couplings can be set. And they can be converted to the constraints on the top quark rare 
decay branching ratios. 
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APPENDIX 

In this appendix, we numerically check the mass cut of the reconstructed particles. As 
stated before, the emission of an extra gluon broadens the mass distributions of reconstructed 
particles and makes 6-jet softer, which decreases the K factor of QCD NLO corrections when 
imposing reconstructing mass cuts or 6-jet p t cuts. The more strict mass cuts are imposed, 
the smaller cross sections we get. On the contrary, if the mass cuts are loose, though 



25 



the cross sections are larger, more background events are also be considered, which may 
decrease the signal to background ratio. As a result, it is difficult to choose mass cuts on 
the reconstructed particles. We have checked that when we change Am# from < 5 GeV to 
< 25 GeV, the sensitivity to the g u t coupling at the 5a level is the lowest when Am# < 20 
GeV, as shown in Table |V] It confirms our choice in Eq. ( 151]) . 



ArriH 


< 5 GeV 


< 10 GeV 


< 15 GeV 


< 20 GeV 


< 25 GeV 


sensitivity to g u t 


0.180 


0.159 


0.157 


0.150 


0.335 



TABLE V: Behavior of the sensitivity to the FCNC g u t couplings as a function of Amn cuts at 
the 5a level. 
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